Learning Visual Attributes
نویسندگان
چکیده
We present a probabilistic generative model of visual attributes, together with an efficient learning algorithm. Attributes are visual qualities of objects, such as ‘red’, ‘striped’, or ‘spotted’. The model sees attributes as patterns of image segments, repeatedly sharing some characteristic properties. These can be any combination of appearance, shape, or the layout of segments within the pattern. Moreover, attributes with general appearance are taken into account, such as the pattern of alternation of any two colors which is characteristic for stripes. To enable learning from unsegmented training images, the model is learnt discriminatively, by optimizing a likelihood ratio. As demonstrated in the experimental evaluation, our model can learn in a weakly supervised setting and encompasses a broad range of attributes. We show that attributes can be learnt starting from a text query to Google image search, and can then be used to recognize the attribute and determine its spatial extent in novel real-world images.
منابع مشابه
Unsupervised Learning of Discriminative Relative Visual Attributes
Unsupervised learning of relative visual attributes is important because it is often infeasible for a human annotator to predefine and manually label all the relative attributes in large datasets. We propose a method for learning relative visual attributes given a set of images for each training class. The method is unsupervised in the sense that it does not require a set of predefined attribut...
متن کاملLearning Predictable and Discriminative Attributes for Visual Recognition
Utilizing attributes for visual recognition has attracted increasingly interest because attributes can effectively bridge the semantic gap between low-level visual features and high-level semantic labels. In this paper, we propose a novel method for learning predictable and discriminative attributes. Specifically, we require the learned attributes can be reliably predicted from visual features,...
متن کاملLearning the right thing with visual attributes∗
Visual attributes are human-nameable semantic properties. They are the adjectives of the visual recognition world, capturing anything from material properties (”metallic”, ”furry”), shapes (”flat”, ”boxy”), expressions (”smiling”, ”surprised”), to functions (”sittable”, ”drinkable”). An attribute may be a binary predicate (”shiny”) or a relative comparison (”shinier than”). Many promising appli...
متن کاملWhat Visual Attributes Characterize an Object Class?
Visual attribute-based learning has shown a big impact on many computer vision problems in recent years. Albeit its usefulness, most of works only focus on predicting either the presence or the strength of pre-defined attributes. In this paper, we discuss how to automatically learn visual attributes that characterize an object class. Starting from the images of an object class that are collecte...
متن کاملThe red one!: On learning to refer to things based on their discriminative properties
As a first step towards agents learning to communicate about their visual environment, we propose a system that, given visual representations of a referent (CAT) and a context (SOFA), identifies their discriminative attributes, i.e., properties that distinguish them (has_tail). Moreover, although supervision is only provided in terms of discriminativeness of attributes for pairs, the model lear...
متن کامل